ACQUISITION  PROCESS 


Looking  at  the 
Root  Causes  of  Problems 


Preventing  Repeat  Mistakes 


Col.  Brian  Shimel,  USAF 


We,  the  acquisition  community,  have  tradition¬ 
ally  supplied  American  fighting  forces  with 
a  distinct  advantage  on  the  battlefield,  and 
ours  is  the  best  equipped  fighting  force  in 
the  world.  But  we  are  also  not  as  efficient 
as  we  would  like  to  be  in  supplying  the  warfighter.  Too 

often,  our  systems  are  delivered  behind  sched-  _ 

ule  or  over  cost.  We  need  to  continue  searching 
for  improvements  in  delivery  time  and  cost  of 
systems. 

One  of  our  key  constituents.  Congress,  cares 
so  much  about  helping  us  improve  our  per¬ 
formance  at  delivering  systems  at  cost  and  on 
schedule  that  it  has  established  mandatory  report¬ 
ing  requirements  whenever  a  program  exceeds 
its  unit  cost  baseline  by  1 5  percent— a  Nunn-Mc- 
Curdy  breach— and  certification  from  the  Office  of 
the  Secretary  of  Defense  when  any  program  exceeds 
its  unit  cost  baseline  by  25  percent  or  more— a  critical 
Nunn-McCurdy  breach. 


In  the 


The  Goldwater-Nichols  Act  streamlined  and  reorganized 
the  acquisition  chain  of  command.  Through  the  program 
executive  officer  structure,  the  Service  acquisition  execu¬ 
tives  struggle  to  deliver  systems  that  work  to  warfight¬ 
ers  actively  engaged  around  the  world,  all  while  facing 
challenges  such  as  creeping  requirements,  cost  and 
schedule  overruns,  and  uncertain  technical  challenges. 

At  the  same  time,  the  career  fields  carrying  out  this 
important  mission  bear  the  brunt  of  workforce  down¬ 
sizing  initiatives  aimed  at  improving  the  so-called 
“tooth-to-tail  ratio.”  (Just  as  an  aside,  how  far  can 
you  cut  before  a  tail  becomes  the  backbone  that 
delivers  the  tooth’s  power?) 


I  propose  we  continue  to  look  to  the  operational 
side  of  our  Services  to  improve  acquisition  per¬ 
formance.  The  difficult  part  is  finding  elements 
from  the  operational  world  that  inspire  the  ac¬ 
quisition  workforce,  fit  the  environment,  and 
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produce  better  performance— it  needs  to  be  more  than 
just  an  organizational  change.  It  is  not  enough  for  a  new 
commander  to  appreciate  his  new  organization’s  per¬ 
spective;  the  organization  also  has  to  reach  out  to  the 
commander  and  respect  his  perspective.  Mutual  respect 
and  understanding  are  the  key  to  true  organizational 
success. 

Taking  the  Root  Cause  Approach 

There  are  operational  ideas  and  practices  that  can  improve 
acquisition  performance.  After  all,  there  is  a  common  trait 
found  in  both  the  operational  side  and  the  acquisition 
side:  a  bedrock  of  respect  for  analysis  and  real  proof  that 
something  will  work  before  we  trust  our  nation’s  defense 
to  a  new  method  or  technology.  Innovation  and  perfor¬ 
mance  based  on  logical  analysis  and  proven  results  are 
the  key  to  operators  and  acquirers  speaking  a  common 
language.  For  example,  in  World  War  II,  the  Army  Air 
Corps  studied  the  success  rates  of  aircraft  returning  to 
English  bases  after  raids  over  the  European  continent. 
Aircraft  were  often  seriously  mangled,  limping  back  over 
the  English  Channel— or  worse.  Through  detailed  obser- 

Ivation  and  analysis,  it  became  clear  that  aircraft  miss¬ 
ing  certain  parts  never  returned.  Those  parts  were 
k  reinforced,  and  more  planes  returned.  This  close 
^  analysis  of  problems  and  solutions  evolved  into  the 
I  creation  of  new  processes,  including  the  develop- 
■  ment  of  the  Safety  Investigation  Board  and  the 
W  Accident  Investigation  Board. 

The  intrusive,  rigorous,  and  respected  process  con¬ 
ducted  by  the  SIB  is  performed  because  the  operational 
world  is  truly  committed  to  finding  the  root  cause  of  the 
problem  and  doing  its  best  to  keep  it  from  happening 
again.  The  SIB  has  two  components.  The  first  part  is  a 
rapid  reconstruction  of  the  facts  that  led  to  the  accident. 
Once  accomplished,  those  facts  are  also  used  for  the  sub¬ 
sequent  AIB,  which  definitively  determines  the  cause(s) 
of  the  accident.  The  second  part  of  the  SIB  is  a  non-at¬ 
tribution,  internal  assessment  of  the  weapon  systems’ 
ability  to  perform  their  mission  for  national  defense.  This 
part  reflects  the  best  professional  judgment  of  the  board 
without  bearing  a  substantial  burden  of  proof  (which  is 
used  by  the  AIB).  The  board’s  experience,  objectivity,  and 
independence  allow  them  to  quickly  get  the  most  prob¬ 
able  answer  to  key  decision  makers.  The  purpose  of  the 
second  part  of  the  SIB  is  to  prevent  future  accidents.  For 
example,  on  April  3,  2006,  a  C-5  crashed  at  Dover  Air 
Force  Base,  Del.  Thanks  to  the  efforts  of  the  SIB  and  the 
AIB,  by  June  21 ,  everyone  (not  just  other  pilots)  could  read 
a  minute-by-minute  account  of  the  flight  and  the  mistakes 
that  led  to  the  crash. 

Applying  Analysis  to  Improve  Acquisition 

I  contend  the  next  step  in  improving  acquisition  is  to  con¬ 
tinue  with  ideas  that  will  make  us,  the  acquisition  commu¬ 
nity,  accomplish  the  goal  of  acting  more  like  warfighters. 


We  should  hold  the  equivalent  of  an  SIB  whenever  a  pro¬ 
gram  suffers  a  critical  Nunn-McCurdy  breach.  We  should 
use  the  results  of  this  objective  process  to  identify  how 
we  operate  an  acquisition  program  and  to  understand 
what  “broke”  the  program  and  how  we  should  behave 
in  the  future  to  improve  performance,  delivery  speed, 
and  economy.  Finally,  we  should  incorporate  the  lessons 
learned  across  the  acquisition  community  and  make  the 
practice  of  them  a  command  responsibility— the  same 
way  we  investigate  and  correct  problems  that  caused  op¬ 
erational  accidents— thus  avoiding  similar  problems  in 
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future  operations. 

Currently,  after  a  critical  Nunn-McCurdy  breach,  the  De¬ 
partment  of  Defense  must  certify  to  Congress  that  four 
key  factors  are  still  true  before  a  program  can  continue  to 
go  forward,  and  four  integrated  process  teams  are  created 
to  review  those  key  factors.  They  evaluate  that  a  program 
is  still  essential  to  national  security;  that  there  is  no  al¬ 
ternative  that  can  provide  an  equal  capability;  that  new 
cost  estimates  are  reasonable;  and  that  the  existing  or 
redesigned  management  structure  is  adequate  to  control 
average  unit  costs  in  the  future.  The  teams  then  make  a 
final  report  and  certification  to  Congress. 

This  current  process  fulfills  the  first  part  of  the  SIB,  but 
it  does  not  address  the  second  part:  making  sure  that  all 
systems  are  still  operating  safely  for  the  benefit  of  national 
defense.  The  operational  side’s  safety  review  team  judges 
whether  the  incident  applies  across  the  entire  fleet.  It 
decides  if  the  responsible  condition  or  behavior  can  or 
should  be  corrected  or  mitigated,  and  these  recommen¬ 
dations  are  put  into  action.  In  the  acquisition  world,  we 
appear  to  act  as  if  each  time  a  program  overruns,  it  is  a 
singular  event.  We  continue  to  do  our  best,  but  only  as  it 
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Defense  AT&L  Soys  Goodbye  to 
Smith  and  Lowery 


With  this  issue,  Defense  ATSlL  says  good¬ 
bye  to  Tech.  Sgt.  James  D.  Smith,  USAF, 
and  Spc.  Kelly  Lowery,  USA.  Smith  and 
Lowery,  both  visual  information  specialists, 
have  supported  the  magazine  in  many  ways, 
most  notably  with  the  onsite  coordination  of 
the  lead  interviews,  where  they  directed  the 
photography  and  managed  the  production  of 
high-quality  audio  recordings. 

Smith,  noncommissioned  of¬ 
ficer  in  charge  of  the  Defense 
Acquisition  University  Visual 
Arts  and  Press  department, 
is  a  gifted  graphic  designer 
who  provided  original  illustra¬ 
tion  for  the  magazine  and  for 
DAU’s  other  periodical.  Defense 
ARJ,  and  provided  design  and 
art  direction  for  many  other 
DAU  publications.  During  his 
1 2  years  of  Air  Force  service, 
he  has  worked  in  other  career  fields,  including 
intelligence  and  aircraft  maintenance.  With 
the  deletion  of  his  current  career  field.  Smith 
is  retraining  as  a  chaplain’s  assistant. 

Lowery  excelled  in  putting  in¬ 
terview  subjects  at  the  most 
senior  levels  at  ease,  ensuring 
appealing  and  natural  pho¬ 
tographs.  A  talented  graphic 
designer,  she  was  responsible 
for  the  redesign  and  art  direc¬ 
tion  of  DAU’s  electronic  em¬ 
ployee  newsletter.  She  holds 
a  bachelor’s  degree  in  graphic 
design  from  Louisiana  Tech 
University.  Lowery  was  named 
enlisted  person  of  the  year  for 
2007.  She  has  begun  a  tour  of  duty  as  a  graph¬ 
ics  specialist  in  Korea. 

James  and  Kelly,  thank  you  for  everything 
you’ve  done  for  Defense  ATSlL  and  for  DAU. 
Good  luck  in  your  future  endeavors.  We’ll  miss 
you! 

Judith  Greig 
Executive  Editor 


meets  budget  constraints,  optimistic  estimates  of  technol¬ 
ogy  maturity,  and  political  compromises. 

To  take  one  program  as  an  example:  In  2001 ,  the  Space- 
Based  Infrared  System  Program  suffered  a  Nunn-McGurdy 
breach.  It  was  restructured  in  2002,  and  the  Government 
Accountability  Office  analyzed  the  changes  in  2003.  The 
GAO  found  that  SBIRS  had  passed  its  critical  design  re¬ 
view,  even  though  just  50  percent  of  its  design  drawings 
were  completed,  compared  to  90  percent  completed,  as 
recommended  by  best  practices.  In  2005,  the  SBIRS  Pro¬ 
gram  suffered  another  breach.  In  2006,  Air  Force  Deputy 
Under  Secretary  for  Space  Programs  Gary  E.  Payton  men¬ 
tioned  SBIRS  in  a  presentation  entitled  “Nunn-McGurdys 
Aren’t  Fun,”  citing  that  after  two  breaches,  there  was  no 
systems  engineering  master  plan  and  no  integrated  mas¬ 
ter  schedule,  among  other  issues.  Granted,  this  is  a  cur¬ 
sory  overview  of  a  complex  program,  but  some  of  these 
problems  sound  predictable  to  me. 

If  we  launched  an  aircraft  with  a  damaged  engine,  we 
would  be  allowing  unsafe  practices.  If  we  started  a  new 
acquisition  program  without  full  funding,  half  its  design 
drawings,  or  no  master  schedule,  we  would  say,  “Good 
luck.”  The  current  process  is  not  serving  us  well.  We  are 
sending  our  acquisition  fleet  back  out  again,  day  after 
day,  hoping  for  the  best,  taking  the  same  risks  over  and 
over  again.  We  must  stop  expecting  different  results  from 
the  same  inputs. 

Obtaining  Different  Results 

In  each  Service,  I  suggest  the  major  command  respon¬ 
sible  for  training,  organizing,  and  equipping  the  acquisi¬ 
tion  workforce  convenes  and  operates  a  review  board 
after  each  critical  breach.  The  major  command  should 
ensure  the  results  are  made  available  through  the  broad¬ 
est  possible  distribution.  One  example  of  potential  candi¬ 
dates  for  this  board  is  the  acquisition  wing  commanders 
in  the  Air  Force.  They  are  not  in  the  acquisition  chain  of 
command,  and  therefore,  they  have  a  measure  of  inde¬ 
pendence  that  would  be  highly  desirable  in  this  role.  The 
Service  acquisition  executive  would  be  responsible  for 
putting  the  appropriate  conclusions  into  practice  before 
every  new-start  program.  The  existing  integrated  process 
teams  would  be  a  good  structure  to  build  on.  We  could 
perhaps  add  to  their  role  or  have  them  feed  information 
to  a  follow-on  board  that  would  be  responsible  for  gather¬ 
ing  evidence  and,  over  a  period  of  time,  creating  a  better 
set  of  principles  under  which  to  operate  major  defense 
acquisition  programs. 

Is  This  New? 

I  have  obtained  great  insight  from  knowledgeable  people 
who  are  experienced  in  the  acquisition  business.  I  have 
read  many  high-level,  top-quality  initiatives,  studies,  com¬ 
missions,  and  reports.  Many  still  influence  our  structure, 
processes,  and  decisions  with  good  intentions  and  results. 
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Many  people  speak  a  common  language  of  speedy,  stable 
acquisition.  The  solutions  that  may  result  from  what  I  pro¬ 
pose  will  not  be  different  from  what  has  been  said  in  the 
past.  So,  what  is  keeping  us  from  making  these  changes 
ourselves?  Have  we  already  met  the  enemy  and,  to  para¬ 
phrase  the  great  words  of  cartoonist  A1  Capp,  is  he  us? 
The  people  at  all  levels  of  acquisition  feel  a  huge  burden 
to  get  working  systems  to  the  warfighter,  and  they  make 
compromises— out  of  necessity— in  technology  maturity, 
schedule,  requirements,  and  funding  that,  frankly,  result  in 
the  unintended  consequence  of  making  us  too  expensive 
and  too  slow— the  verdict  from  the  2005  Kadish  Report 
(also  called  the  Defense  Acquisition  Performance  Assess¬ 
ment).  We  do  a  pretty  darn  good  job  in  acquisition;  but  we 
are  not  as  efficient  as  we  want  to  be  or  as  we  should  be. 
We  get  away  with  it  because  there  is  no  competition. 

I  think  what  is  new  here  is  using  the  Nunn-McCurdy  breach 
as  an  automatic  trigger  to  start  a  review  process  and  to 
apply  the  lessons  learned  across  the  acquisition  commu¬ 
nity  using  the  Service’s  or  defense  agency’s  method  of 
mass  communication.  Payton’s  briefing  title  gives  a  clue 
to  the  current  culture:  “Nunn-McCurdys  Aren’t  Fun.”  He 
is  right,  of  course.  But  maybe  because  we  try  so  hard  to 
prevent  the  breaches  that  when  they  do  occur,  we  don’t 
fully  embrace  the  breach  as  a  chance  to  close  the  loop 
of  a  continuous  improvement  opportunity  to  understand 
what  went  wrong,  and  apply  the  relevant  lessons  across 
all  acquisition  programs. 

The  Defense  Department  should  establish  a  culture  that 
dictates  this:  Some  things  can’t  be  compromised  or  de¬ 
ferred  without  acknowledging  and  accounting  for  the 
measurable  impact  they  will  make  to  a  program’s  de¬ 
livery  speed,  cost,  and  performance.  To  achieve  this,  we 
will  have  to  be  willing  to  admit  our  own  mistakes!  We 
will  have  to  critically  look  at  every  system  overrun,  take 
ownership  of  the  risks  we  imposed  on  ourselves,  and  put 
the  appropriate  resources  into  place  to  handle  the  risk. 
And  we  will  need  to  stop  taking  the  risks  that  continually 
show  up  as  causes  of  failures. 

If  we  accept  that  the  reason  we  need  to  take  a  risk  is 
worthwhile,  then  we  align  sufficient  resources  to  cover  the 
risk.  The  Department  of  Defense  should  be  able  to  stop 
having  to  act  surprised  when  the  overrun  occurs.  It  is  the 
continual  ratcheting  down  of  preventable  errors  and  the 
inevitable  power  of  rising  expectations  and  performance 
that  will  transform  us — not  the  “eureka  moments.” 

Putting  the  Results  into  Practice 

In  the  acquisition  world,  cost,  schedule,  and  performance 
are  the  core  of  our  culture.  The  first  and  foremost  of  these 
is  delivering  the  right  capability  to  the  warfighter.  The 
second  is  delivering  it  on  time.  The  third  is  delivering  it  at 
the  cost  we  expect.  While  we  treat  all  three  seriously,  the 
truth  is,  we  are  most  successful  at  the  first  one  and  less 


Links  of  Interest 


To  learn  more  about  information  cited  in  this 

article,  please  go  to: 

■  <wv\rw.defenselink.mil/news/maY2002 / 
d20020502nmc.pdf> 

■  <  WWW .  acc .  af .  mil /library /factsheets /factsheet_ 
print.asp?fsID=23568cpage=  1  > 

■  <  WWW .  doverpost .  com /postarchives /06-2 1-06/ 
pages /newscrash .  html> 

■  <  WWW .  fas .  or  g  /spp /military /gao /gao-04- 
48. pdf  > 

■  <  WWW .  dtic .  mil /ndia/2006systems  / 
Wednesday /poyton .  pdf  > 


so  at  the  second  two.  We  must  stop  expecting  different 
results  from  the  same  inputs.  We  deliver  the  right  system 
to  the  warfighter,  but  too  often  we  deliver  that  system 
over  cost  and  behind  schedule. 

We  have  to  hold  tough,  thorough  reviews  of  cause/effect 
for  troubled  programs  and  their  environments  in  the  ac¬ 
quisition  world;  unflinchingly  address  our  successes  and 
our  failures;  and  consolidate  our  results  into  actionable 
analysis,  backed  by  the  rare  commodity  of  real  insight. 
Then  we  can  use  that  insight  to  start  and  operate  acquisi¬ 
tion  programs  under  realistic  conditions  of  success.  Only 
when  we  back  changes  with  evidence  and  analysis  will 
we  drive  significant  improvement  in  the  overall  program¬ 
matic  success  of  weapons  development.  If  we  want  to 
seriously  respond  to  Congress  and  add  operator-inspired 
performance,  we  should  treat  every  critical  Nunn-McCurdy 
breach  as  a  Class  A  mishap— an  unacceptable  event— and 
hold  the  equivalent  of  a  SIB  to  determine  the  root  causes 
and  address  them;  publish  the  results;  make  substantive 
changes  to  our  strategies,  tactics,  funding,  staffing,  and/ 
or  training  to  make  fact-based  corrections  and  improve 
how  we  operate  our  mission.  I  recommend  we  invest  in 
this  effort. 

We  might  not  be  able  to  draw  a  conclusion  from  reviewing 
a  single  program  or  a  few  programs,  but  over  time  and 
with  a  larger  sample,  we  will  discover  revealing  trends. 
And  like  the  World  War  II  airmen  who  met  their  chal¬ 
lenges  bravely,  we  may  find  that  programs  with  certain 
issues  rarely  succeed.  We  will  learn  how  trades  in  delivery 
speed,  cost,  and  performance  affect  the  risk  we  will  know¬ 
ingly  accept  or  reject.  Efficient,  timely  delivery  of  effective 
performance  is  our  goal. 


The  author  welcomes  comments  and  questions 
and  can  be  contacted  at  brian.shimel@hanscom. 
af.mil. 
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